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Section V: Summary and Implications 

Excerpted From: Does Professional Development Change Teaching Practice? Results 
from a Three- Year Study 

U.S. Department of Education, Office of the Under Secretary 


The Eisenhower Professional 
Development Program’s primary 
goal is to support professional 
development for teachers that 
will improve classroom practice 
and, ultimately, student 
achievement. AIR’s multiyear 
evaluation of the Eisenhower 
Program sought to provide infor- 
mation to help the Eisenhower 
Program, and other professional 
development efforts, achieve 
this important goal. Our evalu- 
ation was intended to help 
policymakers and program 
managers by (1) describing pro- 
fessional development activi- 
ties supported by the 
Eisenhower program and the 
way they are managed and 
implemented and (2) evaluating 
the effects of the professional 
development activities on 
teaching practice. 

To describe Eisenhower- 
funded activities and the effects 
of professional development on 
teaching practice, the national 
evaluation included both a na- 
tionally representative cross- 
sectional component and a more 
focused longitudinal compo- 
nent. Our analyses based on 
national samples of district 
Eisenhower coordinators, state 
agency for higher education 
(SAHE)-grantee project direc- 
tors, and teachers, were re- 
ported in Caret et ah, 1999. 
They describe the type and 
quality of Eisenhower activities, 
who participates in them, how 
they fit into other reform efforts, 
and how they are managed and 
implemented by districts and 
SAHEs. The Longitudinal Study 
of Teacher Change, described in 
this report, examines the ef- 
fects of Eisenhower-assisted and 
other professional development 


on teachers in 30 schools. We 
analyzed the effects of profes- 
sional development on broad 
and specific measures of teach- 
ing practice: the alignment of 
content coverage with national 
standards; an emphasis on per- 
formance goals for students; 
pedagogical strategies; and 
higher-order use of technology, 
instructional methods, and stu- 
dent assessments. 

The findings and implica- 
tions that we draw from both the 
national and longitudinal data, 
and summarize in the following 
section, extend beyond the 
Eisenhower Program. Although 
our national data on profes- 
sional development focused only 
on Eisenhower-assisted activi- 
ties, the longitudinal teacher 
survey included professional 
development funded by 
Eisenhower and other sources 
as well. This occurred because 
we asked teachers to describe 


The results from our national 
data show the effectiveness of 
specific dimensions of coherence, 
such as discussing professional 
development experiences with 
colleagues and participating in 
follow-up activities that build on 
previous activities. 


the most helpful activity they 
participated in during the 
school year, and some of the 
activities that teachers chose 
were not funded by Eisenhower. 
Nevertheless, because our focus 
in all aspects of our study was 
on relationships between fea- 
tures of professional develop- 
ment and teaching practice, our 
findings apply to teachers’ pro- 
fessional development in math- 
ematics and science in general. 


whatever the funding source. 

The Effects of Profes- 
sional Development on 
Teaching Practice 

On the basis of our national 
data, we concluded that six key 
features of professional develop- 
ment are effective in improving 
teaching practice: three struc- 
tural features (characteristics 
of the structure of the activity) — 
reform t3y>e, duration, and col- 
lective participation — and three 
core features (characteristics of 
the substance of the activity) — 
active learning, coherence, and 
content focus (see Caret et al., 
1999). These findings from our 
national data support other re- 
cent studies that highlight the 
importance of content focus in 
professional development (e.g., 
Cohen & Hill, 1998; Kennedy, 
1998). The features of high- 
quality professional develop- 
ment identified in our national 
data also are consistent with 
ideas articulated in the 
Eisenhower legislation. Further, 
they deepen and extend the 
ideas in the Eisenhower legis- 
lation by providing details about 
what makes professional devel- 
opment effective. For example, 
the Eisenhower legislation pro- 
motes professional development 
that is linked to other reform 
efforts in a coherent, system- 
atic way. The results from our 
national data show the effective- 
ness of specific dimensions of 
coherence, such as discussing 
professional development experi- 
ences with colleagues and par- 
ticipating in follow-up activities 
that build on previous activities. 

The findings from our lon- 
gitudinal data reinforce the im- 
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portance of the six features of 
professional development iden- 
tified in the national study. In 
addition, results from our lon- 
gitudinal study extend our na- 
tional findings by providing evi- 
dence of the link between focus- 
ing on specific teaching strate- 
gies in professional develop- 
ment and having teachers use 
those specific strategies in the 
classroom. Specifically, in our 
longitudinal study, we found the 
following: 

• Professional development fo- 
cused on specific, higher-or- 
der teaching strategies in- 
creases teachers’ use of 
those strategies in the class- 
room. This effect is even 
stronger when the profes- 
sional development activity 
has features of high quality 
(e.g., reform type, active 
learning, coherence, and col- 
lective participation) . 

These findings are especially 
strong because they are based 
on only one professional devel- 
opment experience per teacher 
per year. Teachers may experi- 
ence many professional devel- 
opment activities in one year, 
so it is especially noteworthy 


Our results suggest that 
change in teaching would oc- 
cur if teachers experienced 
consistent, high-quality pro- 
fessional development. 


that we found effects on teach- 
ing practice of the one experi- 
ence that teachers chose to de- 
scribe on our survey. 

Our longitudinal data also 
indicate that professional devel- 
opment is more effective in 
changing teachers’ classroom 
practice when it has specific 
features of high quality, such as 
the collective participation of 
teachers from the same school, 
department, or grade; active 
learning opportunities, such as 
reviewing student work or ob- 
taining feedback on teaching; 


and coherence, for example, 
linking to other activities or 
building on teachers’ previous 
knowledge. These findings are 
based on longitudinal data col- 
lected at three points in time. 
They validate the results from 
our national probability sample 
of teachers in Eisenhower-as- 
sisted activities, which indi- 
cated that features of quality 
were significantly related to 
teachers’ self-reported out- 
comes (Garet et al., 1999). 

Participation in Profes- 
sional Development 

Our findings on the effects of 
professional development 
should be considered in the con- 
text of the nature and quality of 
teachers’ experiences in profes- 
sional development. Our results 
suggest that change in teach- 
ing would occur if teachers ex- 
perienced consistent, high- 
quality professional develop- 
ment. But we find that most 
teachers do not experience such 
activities. On average, the ac- 
tivities experienced by teachers 
in our Longitudinal Study of 
Teacher Change are about the 
same quality as those experi- 
enced by our national sample of 
teachers in Eisenhower-as- 
sisted activities. Our national 
data indicated the following 
about district-supported 
Eisenhower activities: an aver- 
age of only 23 percent of teach- 
ers participating in 
Eisenhower-assisted profes- 
sional development were in re- 
form types of professional devel- 
opment; the average time span 
of a professional development 
activity was less than a week; 
the average number of contact 
hours was 25 and the median 
was 15 hours; most activities did 
not have collective participation 
or a major emphasis on content; 
and most activities had limited 
coherence and a small number 
of active learning opportunities 
see Garet et al.,1999 for more 
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details). In short, nationwide, 
the typical professional develop- 
ment experience was not high- 
quality. Nevertheless, our na- 
tional data also documented 
great variation in the quality of 
teachers’ professional develop- 
ment experiences, which indi- 
cates that at least some teachers 
participate in high-quality activi- 
ties, at least some of the time. 

Our longitudinal data indi- 
cates that the quality of profes- 
sional development experiences 
varies considerably not only 
across teachers at a single point 
in time but also over time for 
the same teachers: 

• Teachers experience profes- 
sional development that varies 
in quality from one year to the 
next. Further, teachers in the 
same school tend to have quite 
different professional develop- 
ment experiences. 

We find a substantial amount of 
year-to-year variation in the 


Both our national and our lon- 
gitudinal data indicate that 
professional development is 
more effective when teachers 
participate with others from their 
school, grade, or department. 


quality of the professional devel- 
opment of individual teachers. 
For example, 79 percent of the 
variation in the span and 62 
percent of the variation in the 
content focus of a teacher’s pro- 
fessional development experi- 
ence are due to year-to-year 
variation. This finding indicates 
that the average teacher’s pro- 
fessional development experi- 
ences do not add up to a long- 
term, coherent, high-quality 
program — the type of program 
that has the most potential for 
fostering significant and lasting 
teacher change. 

We find some variation in 
participation in professional 
development between schools 
(e.g., 14 percent of the variation 
in collective participation and 7 
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percent of the variation in ac- 
tive learning is due to between- 
school variation), but most of 
the variation in the quality of 
the professional development in 
which teachers participate lies 
within, not between, schools. 
This finding supports the idea 
that professional development 
continues to be an individual 
teacher experience. Both our 
national and our longitudinal 
data indicate that professional 
development is more effective 
when teachers participate with 
others from their school, grade, 
or department. Thus, the varia- 
tion in teachers’ professional de- 
velopment experiences within 
the same school helps explain 
why professional development is 
not as effective as it could be. 

Trends in Teaching 
Practice 

Perhaps partly as a result of the 
imeven quality of professional de- 
velopment, we find the following: 

• In our longitudinal sample, 
we find little change in over- 
all teaching practice from 
1996 to 1999. 

Beyond the specific and targeted 
instructional practices, where 
we do observe change as a re- 
sult of professional develop- 
ment, more generally we see 
little overall change in self-re- 
ported teaching practice. Given 
the usual low quality and incon- 
sistent nature of professional 
development in which teachers 
participated, it is perhaps not 
surprising that we find little 
change in overall teaching 
practice over the period of the 
study. Our data show that teach- 
ers’ alignment of content with 
national standards, the goals 
that teachers have for their stu- 
dents, and their basic pedagogi- 
cal strategies appear to remain 
highly stable over time. It may 
be true that teachers changed 
on dimensions that we did not 
measure or that they changed 
the way they implemented cer- 


tain practices instead of chang- 
ing their relative emphasis on 


Our data show that teachers’ 
alignment of content with na- 
tional standards, the goals 
that teachers have for their 
students, and their basic 
pedagogical strategies appear to 
remain highly stable over time. 


these practices. However, given 
the multiple and high-profile 
efforts of standards-based and 
school-based reforms to provide 
professional development to 
change teachers’ practice in de- 
sirable ways, we are surprised 
that teachers, as a group, did not 
move in the directions in which 
reforms intend to push them. 

This lack of results may be 
a function of weak and frag- 
mented professional develop- 
ment. We find professional de- 
velopment with desirable fea- 
tures in short supply, and where 
it does occur, it does not occur 
systematically over time for par- 
ticular teachers. Few teachers 
experience the kind of consis- 
tent, high-quality professional 
development that we have found 
changes teachers’ instruction 
in desirable ways. 

Measuring instruction at 
multiple points over a more ex- 
tended period of time might in- 
crease our ability to capture 
change in average teaching 
practice. However, we are con- 
fident in our results that at least 
for the three years of our study, 
teachers changed little in terms 
of the content they teach, the 
pedagogy they use to teach it, 
and their emphasis on perfor- 
mance goals for students. 

• Despite little average change 
over time in teaching prac- 
tice in our longitudinal 
sample, individual teachers 
in our sample do vary in their 
classroom practices, and 
moderate variation does oc- 
cur in the classroom practice 
of individual teachers from 


year to year. 

Although in our longitudinal 
sample, teachers’ practice did 
not change on average, indi- 
vidual teachers did make mod- 
erate changes in their teaching 
practice from one year to the 
next. For example, 30 percent of 
the variation in alignment and 
28 percent of the variation in 
the use of traditional pedagogy 
is due to year-to-year variation. 
This year-to-year variation might 
be due to teachers’ adapting to the 
ability levels of their students or to 
other influences related to their 
students or school. 

Further, we find a great deal 
of variation across teachers in 
their classroom teaching prac- 
tice. Most of this variation is 
between teachers in the same 
school, not between schools. For 
example, 40 percent of the 
variation in teachers’ use of 
generating hypotheses and 31 
percent of the variation in 
teachers’ use of discussion-ori- 
ented instruction are due to 
variation between teachers in 
the same school. A substantial 
amount of variation between 
schools might suggest a coher- 
ent, organized school-fostered 
system of instruction. Instead, 
we find that individual teachers 
in the same school have very dif- 
ferent teaching practices. This 
finding only adds support to the 
concept that both teaching and 
professional development are 
typically individual experiences. 

Implications for Policy 
and Practice 

In sum, we find that high-qual- 
ity professional development 
that focuses on specific teach- 
ing strategies does affect teach- 
ing practice and that this effect 
is stronger if the professional 
development has the six dimen- 
sions of quality identified in the 
analysis of our national sample 
of teachers — the professional 
development is a reform rather 
than traditional type, is sus- 
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tained over time, involves 
groups of teachers from the 
same school, provides opportu- 
nities for active learning, is co- 
herent with other reforms and 
teachers’ activities, and is fo- 
cused on specific content and 
teaching strategies. However, 
teachers generally do not expe- 
rience consistent, high-quality 
professional development. Pro- 
fessional development remains 
an experience that varies sub- 
stantially from one teacher to 
the next, and even from one year 
to the next for a given teacher. 
Districts and schools face sev- 
eral challenges in providing 
high-quality professional devel- 
opment to all their teachers. 

First, districts and schools 
often must choose between 
serving larger numbers of 
teachers with less focused and 
sustained professional develop- 
ment or providing higher-qual- 
ity activities for fewer teachers. 
As we noted in Caret et al. 
(1999), good professional devel- 
opment requires substantial 
resources. Re-allocating re- 
sources and combining funding 
sources can be effective in in- 
creasing funds for professional 
development. However, in the 
absence of increased resources, 
the federal government, states, 
districts, and schools still have 
to make difficult choices 
whether to sponsor shorter, less 
in-depth professional develop- 
ment that serves a large num- 
ber of teachers or to support 
more effective, focused, and sus- 
tained professional develop- 
ment for a smaller number of 
teachers. The Eisenhower leg- 
islation encourages the idea of 
sustained, intensive profes- 
sional development, and the re- 
sults of this study support the 
idea that districts and schools 
might have to focus professional 
development on fewer teachers in 
order to provide the type of high- 
quality activities that are effective 
in changing teaching practice. 


Second, many districts and 
schools have limited capacity to 
translate into practice the 
knowledge about effective pro- 
fessional development. This 
evaluation has shown that pro- 
fessional development is most 
effective when it has the six fea- 
tures of quality that we identi- 
fied earlier — reform type, dura- 
tion, collective participation, 
active learning, coherence, and 
content focus (also Cohen and 
Hill, 1998; and Kennedy, 1998). 
As we stated in our last report, 
more information is needed on 
the characteristics and condi- 
tions that give some districts 
the capacity to provide this type 
of high-quality professional de- 
velopment. States and districts 
could benefit from more detailed 
information and guidance from 
the federal government about 
how to use the Eisenhower pro- 
gram to design and provide profes- 
sional development that has the 
specific high-quality features that 
make it effective for teachers. 

Third, districts and schools 
often do not have the infrastruc- 
ture to be able to manage and 
implement effective profes- 
sional development. Improving 


Our longitudinal study indi- 
cates that much of the varia- 
tion in professional develop- 
ment and teaching practice is 
between individual teachers 
within schools, rather than be- 
tween schools. 


the quality of professional devel- 
opment is an ambitious under- 
taking. The analysis of data 
from our national probability 
sample of district Eisenhower 
coordinators showed that plan- 
ning that includes system align- 
ment (e.g., the alignment of pro- 
fessional development with 
standards and assessments), 
funding coordination, and con- 
tinuous improvement efforts 
significantly improves the qual- 
ity of professional development 
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activities that districts provide 
(Caret et al., 1999). Case data 
from our 10 districts and data 
from both our national and our 
longitudinal studies indicate 
that some of this planning ex- 
ists but that it is not systematic 
or widespread. Our longitudinal 
study indicates that much of the 
variation in professional devel- 
opment and teaching practice is 
between individual teachers 
within schools, rather than be- 
tween schools. This finding pro- 
vides evidence that schools gen- 
erally do not have a coherent, 
coordinated approach to profes- 
sional development and instruc- 
tion, at least not an approach 
that is effective in building con- 
sistency among their teachers. 
Participation in professional 
development is largely an indi- 
vidual teacher’s decision; 
teachers often select the profes- 
sional development in which 
they will participate from a num- 
ber of options available from a 
highly disparate set of providers. 
An increased emphasis by the 
Eisenhower program on the 
importance of strategic, system- 
atic planning for professional de- 
velopment may encourage both 
districts and schools to improve 
their efforts in this area. 

In sum, our findings show 
that the most effective profes- 
sional development is focused 
on specific higher-order teach- 
ing strategies and has features 
of high quality. Our national 
data, however, showed that on 
average, teachers do not expe- 
rience high-quality professional 
development. Having a coher- 
ent, long-term plan would en- 
able districts and schools to pro- 
vide both the depth of profes- 
sional development experiences 
needed for them to be effective 
and the breadth of coverage of 
specific content and teaching 
strategies that teachers should 
learn over time. The provision 
of high-quality programs of pro- 
fessional development by 
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schools and districts may not 
completely solve the problem of 
the variation in the quality of 
professional development, since 
participation in professional 
development remains primarily 
the decision of individual teach- 
ers. Nevertheless, districts and 
schools could go a long way in 
developing high-quality profes- 
sional development activities. 
To develop meaningful profes- 
sional development plans, dis- 
tricts and schools would have to 
overcome challenges to focusing 
on and setting priorities for pro- 
fessional development activi- 
ties over time, given limited re- 
sources; acquiring knowledge 
about the features of effective 
professional development; and 
building the infrastructure to 


design and implement the types 
of activities that teachers need 
to improve student learning. 
The Eisenhower Professional 
Development program and other 
sources of funding could con- 
tinue to play an important role 
in helping districts and schools 
overcome these challenges and 
develop high-quality profes- 
sional development experiences 
that will lead to better teaching 
and better learning. 
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